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Abstract. A critical assessment of the quality of the Hipparcos data, partly supported by a completely new analysis of the raw 
data, is presented with the aim of clarifying reliability issues that have surfaced since the publication of the Hipparcos catalogue 
in 1997. A number of defects in the data are identified, such as scan-phase discontinuities and effects of external hits. These 
defects can be repaired when re-reducing the raw data. Instabilities in the great-circle reduction process are recognised and 
identified in a number of data sets. These resulted mainly from the difficult observing conditions imposed by the anomalous 
orbit of the satellite. The stability of the basic angle over the mission is confirmed, but the connectivity between the two fields of 
view has been less than optimal for some parts of the sky. Both are fundamental conditions for producing absolute parallaxes. 
Although there is clear room for improvement of the Hipparcos data, the catalogue as published remains generally reliable 
within the quoted accuracies. Some of the findings presented here are also relevant for the forthcoming Gaia mission. 
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1. Introduction 

1.1. Background 

The Hipparco s mission (lESAl Il997l IPerrvman et ail 1 19971 
Ivan Leeuwenll 19971 iKovalevskvIl 1 9981) involved a wide range 
of new concepts applied under what accidentally became very 
difficult conditions. These new concepts were ultimately all 
aimed at obtaining absolute parallaxes for a selection of ap- 
proximately 118000 stars and in this the mission largely suc- 
ceeded. The publication in May 1997 of the catalogue, based 
on the data reduction results obtained by the two independent 
reduction consortia FA ST dKovalevskv et all 19921) and NDAC 
jLindegren et al.l 119921) . took place according to a time sched- 
ule set by the Hipparcos Science Team in agreement with the 
European Space Agency dPerrvman et alJlT997l) . This did not 
allow for final iterations and reflections on methods used and 
results obtained to take place. It is therefore not surprising that 
a number of incidents in the data have not been fully appreci- 
ated during the preparation of the catalogue. 

Some, but not all, of the problems in the Hipparcos data 
that have since been detected can be traced back to the orbit 
anomaly suffered by the mission. Instead of operating at a geo- 
stationary position, Hipparcos described a geostationary trans- 
fer orbit of 10.7 hours, for which the perigee height had been 
increased to an average of450km(Dalla Torre & van Leeuwen 
2003). With a rotation period of just over 2 hours, a single orbit 
covered close to five revolutions of the satellite. No observa- 
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tions could be made when the satellite was out sight for all 
of the three ground stations. This always happened for about 
2 hours around the perigee passage but could also occur for 
other reasons. The data obtained during one orbit will be re- 
ferred to as a data set. 

Since the publication of the Hipparcos catalogue, it has ap- 
peared that for (small groups of) bright stars one of the two 
basic conditions for obtaining absolute parallaxes may not al- 
ways have been properly fulfilled. These two conditions are: 

- A very stable basic angle, with variations well below 1 mas 
over a 10 hour period: all available data show that this con- 
dition was well fulfilled for more than 99 per cent of all 
data sets; 

- A reconstruction of the satellite's scan phase (the so-called 
along-scan attitude reconstruction) which is at all times 
based on significant contributions from data obtained in 
both fields of view. The along-scan attitude reconstruction 
provides the reference frame for the Hipparcos measure- 
ments, which come in the form of transit times or abscissae 
(t he along-sc an coordinate of the star (see further Volume 
3. lESAll997k 

The latter condition will be referred to as the "connectivity 
requirement". It lies at the heart of the Hipparcos concept: 
through fulfilling this requirement the effects of parallax dis- 
placements in the measurements can ultimately (through it- 
erations with the sphere reconstruction and the astrometric- 
parameter determinations) be eliminated from the along-scan 
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attitude reconstruction. A reference frame unaffected by paral- 
lax displacements is essential for obtaining absolute parallaxes. 

A local failure in the connectivity requirement could ex- 
plain the apparent problem with the Pleiades parallax as de- 
rived from the Hipparcos catalogue. That there may be prob- 
lems with the Hip parcos determina t ion of th e Pleiades parallax 
at 8.35 mas llvan Leeuwenl ll999a: Robichon et al. 1999) has 
been suggested by several au t hors before ( Pinsonneault et al. 
1998 | ISoderblom etalJll993 lReidlll999l IPinsonneault et alJ 
2000llStello & NisserfeOO it IPinsonneault et alJl2003l) . but of- 
ten without sufficient understand ing of how such a discrep - 
ancy could occur locally only aravanan &r,oiilol fl999). 
Statistical tests on the data rule out global discrepancies in both 
the parallax zero point and the formal errors on t he astrometric 
parameters jArenou et alJl995ULindegrenll995i) . Independent 
geometric determinations of the Pleiades parallax are very hard 
to obtain, as the cluster velocity and dista nce make it unsuit - 
able for a convergent-point determination llvan Leeuwenl2005l) . 
As not all studies seemed to contradict the Hipparcos result 
JCastellani et alJl2002l IPercival et aDl2003l) . it remained un- 
clear where the fault may lie. In a more recent paper though, 
Percival et al. considered the tra ditional longer distance the 
more probable JPercival et all2005T) . 

Some further information has recently c ome from stud- 
ies of individu al b i nary stars in the c luster llPanetal]l2004l 
iMunari et aD 12004 IZwahlen et aDl2004 . which all indicated 
the larger distance of 130 to 135 pc. The first two of these stud- 
ies still contain a model element (they are not purely geomet- 
ric), only the third of these studies provides a pure geometric 
determination. All three provide the dista nce of a s ingle star 
in a cluster with a diameter of 20 pc ( Ivan Leeuwenlll98d) . al- 
though as bright stars and binaries they are more likely to be 
found close to the centre of the cluster llvan Leeuwenl ll980: 
Rab oud & Mermilliodlll998i) . The measurements of the p aral- 
laxes of a few stars with the HST JSoderblom et alJl2004l) also 
confirm the larger distance, but those observations pertain to 
differential rather than absolute astrometry. 

Limited corrections of the published Hipparcos data are 
possible and had been foreseen in its preparation by mak- 
ing available intermediate astrometric and photometric data, 
and providing details of the colour indices used in the data 
reductions. This made possible, for example, the improve- 
ments to the astrometry for the very red, large-amplitude 
variables dPourba ix & .TorisserfeOOol IPourbaix & Boffirl2 003 ; 
iKnapp et alJl200lM2003h . The repair of potential connectivity 
problems, however, requires information that can only be ob- 
tained from the original, raw data. 

The present paper does not intend to settle the question of 
the Pleiades parallax, but rather to give a frank overview of is- 
sues that have surfaced in a new analysis of the raw data as 
well as in the intermedi ate data prod ucts made available with 
the Hipparcos catalogue llESAll997l) . As explained above, one 
of these issues, connectivity, may well have a bearing on the de- 
termination of the Pleiades parallax. The present paper is also 
in a way a justification for the preparation and presentation of 
a complete new reduction of the raw Hipparcos data, presented 
in the accompanying paper. To present a complete new reduc- 
tion of those data involves a very substantial amount of work, 



which can only be justified if it provides very significant im- 
provements in accuracy and overall reliability. As will be ex- 
plained in this and the accompanying paper, this is likely to be 
the case. 

1.2. Structure of the present paper 

This paper is organised as follows. Section |2] presents issues 
affecting the reconstruction of the along-scan attitude: methods 
applied to the reconstruction, and peculiarities of the scanning 
of the satellite. Although recognised to exist in the original re- 
ductions, the frequency and effects of scan-phase discontinu- 
ities and external hits had been grossly underestimated, and 
no measures were available to systematically identify and in- 
corporate these events in the along-scan attitude reconstruction 
models. 

A major role in the original reductions was played 
by a process refer r ed to as the great-circ l e reduction 
(Ivan der Marell Il988t Ivan der Marel & Petersen! fl99l IeSAI 
ll997Hvan Leeuwenll997iT This process allowed, through com- 
bining the corrections to abscissae, the along-scan attitude and 
a set of instrument parameters, to obtain a reliable attitude re- 
construction even in the presence of relatively high errors on 
the reference positions for the stars involved. A single great- 
circle solution used the data obtained over one orbit, and as 
such involved data for up to four revolutions of the satellite. 
All data obtained over this interval were projected on a refer- 
ence great circle to provide a single abscissa measurement for 
each star observed. These combined abscissae from the great- 
circle solutions will be referred to as orbit- transits. They com- 
bine data for on average 3 to 4 transits through either of the two 
fields of view. Section [3]presents problems experienced in the 
great-circle reduction, most of which were indirectly caused 
by the orbit anomaly. When, due to ground-station unavailabil- 
ity or problems with on-board attitude control, the usable data 
obtained over an obit covered two revolutions or less, the basic 
angle between the two fields of view (58°) allowed for instabili- 
ties to develop between the estimates of the along-scan attitude 
and the determination of the abscissa corrections. This could 
also happen in orbits where the observations were frequently 
interrupted by Earth occultations (the image of the Earth com- 
ing too close to one of the apertures to continue observing). 

Section |4] reviews the status of the basic-angle stability. 
Here we draw mainly from the results of the new reduction 
to show that the stability of the basic angle has been very good, 
down to a 0. 1 mas level over a 1 hour period. However, 1 8 or- 
bits (out of 2300) are identified where the basic angle did show 
a significant drift; in almost all cases these drifts are directly 
related to known anomalies in the operations of the spacecraft 
and payload. 

Section [5] presents our current understanding of the im- 
portance of connectivity: the way data from the two fields of 
view become connected in the data reductions through the re- 
construction of the along-scan attitude. As was stated above, 
good connectivity and a highly stable basic angle are essential 
for obtaining absolute parallaxes. We also examine methods 
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suggested for correcting poor connectivity by Makarov (2002, 
2003). 

In Section[6]some statistical properties of the abscissa data 
in the published catalogue and the role played by the merging 
of the data from the two reduction consortia are reflected upon. 
The verification possibilities of the formal errors and the paral- 
lax zero point for the published data are also briefly reviewed 
in Sectional Finally, Section [8] summarises the conclusions of 
the current study. 

1.3. Presentation 

Formal errors on abscissa measurements presented here are 
generally examined as a function of the total photon count or 
integrated intensity of the underlying observations. The observ- 
ing strategy for Hipparcos led to variable amounts of integra- 
tion time being assigned to observations, depending on stellar 
brightness as well as on the presence of other program stars 
on the main detector area. The integrated intensity is therefore 
a much more representative quantity for accuracies than is the 
stellar magnitude. 

Data sets will generally be referred to by their orbit number. 
Orbits were numbered sequentially as they took place, irrespec- 
tive of whether data was collected. The first orbit formed part 
of the test phase and took place on 5 November 1989, while the 
actual survey began at orbit 48 on 26 November 1989. The last 
orbit with data, orbit 2769, took place 1207.8 days later, on 18 
April 1993. 

The abbreviation "mas" will be used for 10~ 3 seconds of 
arc. Torques will often be represented in the equivalent units 
for acceleration (mas s~ 2 ) rather than in Nm, with values di- 
rectly related through the diagonal elements in the inertia ten- 
sor. In integrations for the dynamical modelling, however, all 
calculations are done using the full inertia tensor and torques 
expressed in the proper units. 

1.4. Other information 

It is in no way the intention of the current study to discredit the 
work and products of the two data reduction consortia. Much 
more powerful computing hardware makes investigations pos- 
sible that were quite difficult 10 to 15 years ago. Processing 
power, data handling facilities and graphical display capabili- 
ties have all improved very significantly over those years. 

This study has progressed over 7 years, starting from the 
basic ideas of the FAST and NDAC consortia on the reduction 
of the data, and some elementary parts of the new reduction are 
still identical to what was developed 20 years ago. It shouldn't 
harm anyone to have a critical look at what was done then, to 
see if better results may be obtained from the same data. The 
Hipparcos data can never be replaced, and if more accurate and 
reliable information can be extracted from it, then this has to 
be done, and can only be done by studying in great detail the 
raw data and intermediate results from the published data. The 
stars most likely to be significantly affected by any potential 
improvements of the Hipparcos astrometric data are the bright- 
est stars (V< 8), for which the main contributions to the formal 
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Fig. 1. The background in the V channel of the star mapper 
for orbit 320 (end March 1990). The vertical scale is given as 
an approximate equivalent of stellar magnitude. The horizontal 
scale goes from perigee at -0.5 to apogee at 0.0 to perigee at 
0.5. One full orbit covers close to 5 revolutions of the satellite. 
Visible near the centre of the graph are the crossings of the two 
fields of view through the zodiacal light and the galactic plane. 
These crossings are repeated around phases -0.2 and +0.2. 

errors on the astrometric results in the published catalogue are 
modelling errors rather than photon noise. New missions, like 
Gaia, will find it difficult or impossible to obtain data for these 
stars, for which the images may be fully saturated. 

2. Scanning problems 

Problems related to scanning naturally split in two components: 
the characteristics of the actual scanning motion of the satel- 
lite, and our modelling of these characteristics. The second 
part of the problem is generally referred to as the attitude re- 
construction. In the Hipparcos reductions little attention was 
given to the first part: it was generally considered too com- 
plex for modelling, and exact cubic splines were used to fit 
positional displacements for the attitude modelling, irrespec- 
tive of the dynamics of the satellite. The only exceptions are 
the preliminary studies on the torques affecting the satellite by 
Ivan Leeuwen et all (1992) and Ivan Leeuwen! J 19971) as part of 
the NDAC activities. In the following sub-sections a brief sum- 
mary of steps taken in the attitude reconstruction is presented, 
followed by descriptions of the three main disturbances ob- 
served in the scanning motion of the satellite: the scan-phase 
discontinuities, the external hits and the torque irregularities. 
A more detailed discussion of the methods used in the att itude 
reconstruction can b e found in Volume 3 of IESAI ill 9971) and 
Ivan Leeuwen! i 19971) . 

2.1. Steps in the along-scan attitude reconstruction 

The Hipparcos attitude reconstruction consisted of two 
main steps: a first approximation for all three coordi- 
nates using the star m apper data JPonati & Sechil Il992t 
Ivan Leeuwen et all Il992l) . followed by an improvement in 
the along-scan attitude based on the main detector measure- 
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merits as part of the great-circle reduction (Ivan der Mare ll 19881 
Ivan der Marel & Petersen! 19921) . The first stage of the attitude 
reconstruction had two purposes: to provide the instantaneous 
position of the spin axis of the satellite to a l<x accuracy of 
100 mas, and the along-scan attitude with a similar or bet- 
ter accuracy. The first was set by the great-circle solution (see 
Section[3j and was based on the noise introduced when project- 
ing transits on a reference great circle. The second requirement 
was essential for the proper identification of a star position on 
the modulating grid during a transit. The modulating grid had 
a period, as projected on the sky, of 1.2074 arcsec, and exces- 
sively large errors in the first step of the attitude reconstruction 
could lead to slit ambiguities. 

The first stage of the attitude reconstruction, using the star 
mapper data, could at times be badly affected by high detec- 
tor noise, in particular during transits of the Van Allen Belts, 
which took place twice every orbit (Fig. [Q. The background 
signal during these transits often left all but the brightest stars 
obscured, thereby limiting severely the possibility to accurately 
reconstruct the attitude. Away from those regions, the lcr er- 
rors on the reconstructed position of the spin axis were around 
80 mas, and for the along-scan phase estimates around m 40 
mas, but it is likely that for periods of high background the 
errors were considerably larger. 

In the second step of the attitude reconstruction the dif- 
ferences between the predicted and observed positions for the 
main-grid transits were fitted using cubic splines, while at the 
same time estimating the corrections to the predicted positions. 
It is from graphs of these differences that scan-phase disconti- 
nuities and external hits can be recognised. 

2.2. Scan-phase discontinuities 

Scan-phase discon tinui t ies ar e briefly explained in Volume 2 
(Section 11.4) of IeSAI dl997l) . where their effect on the data 
was considered insignificant, as at that stage only very few had 
been detected. In the new reduction of the data, however, some 
1500 discontinuities ranging from 20 to 120 mas have been 
identified as the main source behind a non-Gaussian noise com- 
ponent in the abscissa residuals. 

A scan-phase discontinuity is like a jump (Fig. [2jl, and as 
such is directly related to the rigidity of the satellite: as the to- 
tal angular momentum of the satellite is not affected, a jump has 
to be the result of one part of the satellite moving with respect 
to some other part. A clear indication of which part may be 
moving comes from the temporal distribution at which jumps 
take place: a large fraction is directly linked to eclipses, when 
the satellite moves in to, or out of, the Earth shadow. These 
jumps appear to be immediate reactions to the strong tempera- 
ture changes taking place at these instances (Fig. [5}- Jumps are 
otherwise found to be concentrated around (but not restricted 
to) an interval of about 45° ±25° in the rotation phase of the 
satellite. The rotation phase, by definition, represents the direc- 
tion of the solar radiation seen from the satellite. Both aspects 
point to an external element of the satellite, and the most obvi- 
ous candidate is any one of the three solar panels, as was also 
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Fig. 2. Scan-phase discontinuities are observed when the satel- 
lite is warming up or cooling down rapidly, for example after 
an eclipse as shown here for orbit 253 (Febr. 1990). The dis- 
continuities reflect discrete adjustments of the structure of the 
satellite to the changes in temperature. Here 4 jumps (at phases 
-0.2676, -0.2667, -0.2640, -0.2600) of around 40 to 70 mas 
in scan phase are observed from the abscissa residuals with 
respect to the star-mapper based reconstruction of the along- 
scan attitude. The crosses and circles represent data from the 
two fields of view. The data points are weighted averages over 
10.6 s of observations. The vertical lines represent thruster fir- 
ings. 
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Fig. 3. The distribution of scan-phase discontinuities over 500 
days of the mission. Every dot represents a recorded jump. The 
grey areas are times of eclipses. Jumps are clearly concentrated 
towards the start and end of eclipses, but also occur systemati- 
cally away from those events. As the orbital period of the satel- 
lite was close to five complete rotations, the rotation phase of 
the satellite for a given orbital phase changed little from one 
orbit to the next. Jumps tend to concentrate around a fixed rota- 
tion phase of the satellite, causing the high levels of correlation 
in the diagram. 

identified in the earlier preliminary investigations on this sub- 
ject. 

We can estimate the amplitudes of the possible displace- 
ments from the sizes, masses and inertia moments involved. 
Each solar panel measures 1.69 by 1.39 m and has a mass of 
6.363 kg. They are connected (on the shorter side) to the space- 
craft at 0.9546 m from the spin axis. Assuming an even mass 
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Fig. 4. The reduction in the abscissa dispersions due to, 
amongst others, the detection of scan-phase jumps shows in 
a comparison between results before removal (open symbols) 
and at the end of the fourth iteration (filled symbols), when 
nearly all these defects had been detected and incorporated in 
the modelling. A further difference is visible for the low inten- 
sities, where in the earlier stages of the reduction the cut-off 
criterion for poor-quality measurements had been set too low, 
creating artificially low dispersions. The slope of the diagonal 
line represents the contribution of the Poisson-noise. 

distribution, the inertia moment of a single solar panel around 
the spin axis is 23.15 kg m 2 . The inertia moment around the 
spin axis for the entire satellite is 459 kg m 2 , giving a ratio of 
1:19 for a single solar panel versus the rest of the spacecraft. 
The rotational displacement of a solar panel required to give a 
40 mas rotation of the payload is therefore just over 0.75 arc- 
sec. At the point of attachment of the solar panels, a 0.75 arcsec 
rotation amounts to a shift of 3.4 /mi. Thus, very small discrete 
displacements in the solar panel positions with respect to the 
spacecraft are sufficient to cause the observed scan-phase dis- 
continuities. 

Jumps tend to be negative at the start of an eclipse, and pos- 
itive after, which may be expected when heating up and cooling 
down cause opposite movements. Jumps do occur also in a sys- 
tematic manner away from eclipses, and are noticeably more 
frequent in the few hours after the perigee passage (Fig. [3}. 
During the perigee passage the outer layers of the Earth at- 
mosphere can affect the temperature of the solar panels, and 
possibly in some cases even the position. 

The overall effect of phase jumps on the published data is 
difficult to assess. The amount of data potentially directly af- 
fected can be estimated from the number of jumps detected: 
around 1500. The time interval around a jump for which the 
attitude reconstruction is affected if the presence of the jump is 
not incorporated in the attitude model is about 150 s. The to- 
tal amounts to approximately 3 to 4 per cent of the mission. It 
is difficult to estimate how these jumps may have affected the 
along-scan attitude reconstruction in the great-circle reduction 
due to the way the data are projected on a reference great cir- 
cle. As a result, local problems in the scanning can replicate be- 
tween different revolutions of the satellite and between differ- 



ent parts of the scan. The affected time may therefore be much 
larger, with the effects of a phase jump repeating at intervals of 
the basic angle, 58°. Such error correlations are observed in the 
statistics for abscissa residuals (Ivan Leeuwen & Evansl ll998) 
for intervals up to eight times the basic angle. This "spread- 
ing out" of scan-phase problems is for example displayed by 
the systematic effects observed in the abscissa residuals in or- 
bits 721 to 796 (covering days 638 to 660 in Fig. [3}- These 
orbits are all affected by phase jumps that are not directly as- 
sociated with an eclipse. The abscissa residuals for these or- 
bits in both the FAST and NDAC solutions show a relatively 
high level of systematics, spread over all rotation phases, and 
in some cases resembling phase jumps. Contrary to the assump- 
tions for the published data, statistics from the new reduction 
clearly indicate that these phase jumps did impose a significant, 
non-Gaussian, noise component on the abscissa residuals. This 
is shown most clearly in the noise levels of the abscissa resid- 
uals before and after detecting and taking care of these events 
(Fig.0. 

2.3. External hits 

The first hits of the spacecraft were recognised by the NDAC 
team during initial inspections of the gyro data. A hit of the 
spacecraft causes a discontinuity in its inertial rates. Such dis- 
continuities were also caused by thruster firings, but the in- 
stances of the firings were known from the satellite teleme- 
try, and firings always took place in a designated time inter- 
val. Inertial rate discontinuities not associated with thruster 
firings and not in the designated time interval could safely 
be attributed to external hits. The largest of these caused rate 
changes at a level of a few arcsec s _1 and four of these have 
been recorded over the mission. In the NDAC solution these 
events were incorporated in the attitude model in the same way 
as thruster firings; in the FAST reductions the gyro data were 
not analysed and the affected data have most likely been re- 
jected at some stage in the reductions. 

Many more smaller hits took place, but these could not be 
recognised from the gyro data because of noise levels. Smaller 
hits do show up, however, in the behaviour of the abscissa 
residuals with respect to the star-mapper based attitude recon- 
struction, as shown by the example in Fig. [5] Some 150 of these 
hits have now been recorded, none of which had been incorpo- 
rated in the reduction of the Hipparcos data. As with the phase 
jumps, the fraction of time directly affected is relatively small, 
about 0.4 per cent, but due to propagation in the great-circle 
reduction, more data may have been indirectly affected. 

The actual energy transfer associated with a hit producing a 
Aw = 5 mas s" 1 rate jump is surprisingly small. With an inertia 
moment around the spin axis of I., = 459 kg m 2 and a nominal 
scan velocity of 168.75 arcsec s _1 , the change in rotational en- 
ergy is about 9nJ. The change in angular momentum provides 
a lower limit of the typical particle mass involved: 



where v the velocity of the particle, and r max the maximum arm- 
length of the impact position (about 0.95 m). At typical veloc- 
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Fig. 5. A small external hit of the satellite as reflected in the 
abscissa residuals relative to the star-mapper based scan-phase 
reconstruction. The data are for orbit 715 (Oct. 1990), for which 
the scan velocity at orbital phase -0.05148 changed abruptly 
by 4.7 mas s _1 . The crosses and circles represent data from 
the two fields of view. The data points are weighted averages 
over 10.6 s of observations. The vertical lines represent thruster 
firings. 



ities of around 30 km s _1 , the masses of the particles involved 
are small (10 -3 to 10~ 4 mg). However, the shape of the satellite 
is such that the torque for the spin direction caused by a par- 
ticle hit will have been relatively inefficient in most cases, and 
the actual particle masses involved in these hits are likely to be 
larger than indicated by the angular- momentum transfer for the 
spin axis. The same uncertainty of where a particle may have 
hit, and how much it changed the rates on the other two axes 
(where due to the 100 times higher noise levels the measure- 
ments are too unreliable), means that we cannot obtain reliable 
statistical information from these events. 
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Fig. 6. Reconstructed torques around the spin axis for one ro- 
tation of the satellite around apogee, expressed in equivalent 
accelerations. From top to bottom: orbits 1317, 1318 and 1320. 
The torques in orbit 1318 are significantly disturbed, possibly 
due to solar wind following high solar activity. 



2.5. Conclusions on scanning problems 



2.4. Torque disturbances 

Torque disturbances are observed around apogee during or 
shortly after times of high solar activity (Fig. These may 
be related to the position of the bow-shock of the Earth's mag- 
netic field, which can go down to the altitude of geostationary 
orbits in the presence of strong solar winds. The main effect 
on the data is a requirement for a significant increase in the 
number of nodes in the spline function, which can weaken the 
solution. In the NDAC and FAST data analysis increases in the 
number of nodes were determined automatically on the basis 
of the dispersion of the data. In the published data, the data sets 
concerned do not appear to be badly affected. 

Problematic attitude behaviour was also encountered 
around the start and end times of eclipses, when solar radiation 
torques change rapidly. It is difficult to retrace in the Hipparcos 
data how the NDAC and FAST solutions coped with these sit- 
uations, as the same orbits are also affected by the scan-phase 
discontinuities. In both reduction chains the abscissa residuals 
for these orbits show well above average levels of abscissa- 
error correlations. 



A re-analysis shows that scanning problems affect the quality 
of the Hipparcos data for a significant number of orbits. The 
great-circle reduction procedure tended to transpose any such 
problems to other parts of the great-circle solution due to the si- 
multaneous solution for the abscissa corrections and the along- 
scan attitude modelling (see Section^. 

One aspect of the systematics in the abscissa residuals 
is the way these are often correlated between the FAST and 
NDAC solutions, as shown for example in Fig.Q These corre- 
lations had also been noticed by Frederic Arenou (see Volume 
3, Chapter 17, of ESA 1997). They could be expected in two 
situations: when there are (common) systematic errors in the 
astrometric catalogues used for the final reductions, or when 
the errors are caused by intrinsic, uncorrected problems with 
the data, such as scan-phase or velocity jumps. The first so- 
lution seems unlikely (but can't be entirely excluded) due to 
the independent developments of intermediate catalogues used 
in the reductions. The second solution is more plausible, and 
could be the result of the scanning problems (scan-phase dis- 
continuities, hits) described above. In both cases there is clear 
room for improvements in the Hipparcos results. 
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Fig. 7. Abscissa residuals for part of orbit 237. From top to bot- 
tom: results from the FAST, NDAC, and new reductions. The 
residuals in the FAST and NDAC solutions are clearly corre- 
lated, which may be a reflection of the presence of uncorrected 
scan phase discontinuities in this orbit. 



3. The great-circle reduction 

3.1. Brief overview 

For an overview of the mechanism of the grea t-circle reduction 
the reader i s referred to Ivan Leeuwenl Jl997l) or Volume 3 of 
ESA Jl997h . Here only the main points will be reviewed. 

The great-circle reduction (GCR) combined the solutions 
of three parameter sets: corrections to the along-scan attitude, 
the stellar abscissae, and the instrument parameters. These so- 
lutions were linked to accommodate the rather large errors in 
the a priori astrometric data for the mission's program stars. 
By measuring the same stars several times over one orbit the 
contributions from the three parameter sets could be disentan- 
gled. For the nominal mission the length of time covered by one 
great-circle solution would have been 5 revolutions (of 2.13 h) 
of the satellite, resulting in on average 6 to 7 field transits per 
star. The basic angle had been optimised at 58° for this situa- 
tion. Optimisation is obtained through convolving observations 
of the two fields of view in successive revolutions of the satel- 
lite with a sinusoidal function with a period equal to the basic 
angle. This is done for different numbers of satellite revolu- 
tions and different basic angles, as shown in Fig.[S]for 3 and 5 
revolutions: when an integer number of basic angles fits within 
an integer number of revolutions of the satellite, a resonance is 
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Fig. 8. Resonance tests (see text) on basic angle values for 5 
(top) and 3 (bottom) revolutions of the satellite. The value of 
58° at 5 revolutions was chosen, but this allowed some reso- 
nances in the recovery mission, where the lengths of data sets 
are rarely more than 4 revolutions. 



created which can lead to instabilities in the astrometric solu- 
tion. 

The limitations imposed by the recovery mission provided 
between 2 and 4 revolutions, and an average over the mission 
of 3.5 field transits per star per orbit. To see how this may 
have affected the overall quality of the Hipparcos data, the ab- 
scissa residuals as provided for each star in the Intermediate 
Astrometric data file of the Hipparcos catalogue were re- 
grouped again per orbit and reduction consortium. 

3.2. Short data sets 

An indicator of the global quality of the great-circle reduc- 
tion results is the abscissa dispersion for the brighter stars. 
Figure [9] shows the results for the FAST, NDAC and new so- 
lutions, with a clear increase in dispersion for the shortest data 
sets, but also with the majority of the data sets performing 
quite well. In the weighting of the abscissa residuals for the 
astrometric parameter solutions of individual stars, the formal 
errors took into account the overall variance of the abscissae 
in an orbit. Whenever the variance was above average, how- 
ever, the abscissa errors were mostly systematic rather than 
random. An example of this is shown in the results for orbit 
95, December 1989, containing two large gaps due to Earth oc- 
cultations which prevented the ring in the great-circle reduction 
from being closed (Fig.lim. The closing of the ring, achieved 
by obtaining data well distributed over a great circle, was an 
essential condition to stabilise the solution. The way these sys- 
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Fig. 9. The abscissa dispersions for stars brighter than 8 th mag- 
nitude against the total number of field transits (as a measure of 
the time coverage of the data). Each point represents the data 
for one orbit. From top to bottom: results for FAST, NDAC and 
the new reduction. Increased dispersions for the short data sets 
(low numbers of field transits) are an indication of the instabil- 
ities that could occur in the great-circle solution. The applica- 
tion of a 3<x cut-off for outliers make the FAST and NDAC data 
look better than the new reduction, where no cut-off is applied 
other than as indicated by signal-quality criteria. 



tematic errors have been dealt with in the further application 
of those data is clear when examining the formal errors as- 
signed to the abscissa residuals, and comparing these with a 
well-covered orbit (Fig. ^2 where the total transit intensities 
have been reconstructed from the new reduction). The effect of 
this on the final astrometric data is probably small. For the ma- 
jority of brighter stars the formal errors assigned to the abscissa 
residuals in data sets with large systematic errors are relatively 
large so that they added little weight to the solutions. The new 
solution allows a full recovery of all data thus affected. 

3.3. The 6 th and 12 th harmonics 

The so-called 6 th harmonic concerned a special kind of insta- 
bility in the great-circle reduction caused by the proximity of 6 
times the basic angle to a full circle. As shown in Fig. [S] this 
significantly reduced the stability of shorter data sets. The 6 th 
harmonic has been removed from the data as part of the sphere 
solution, though one data set in the FAST reductions seems to 
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Fig. 10. The abscissa residuals for orbit 95 in the three reduc- 
tions, showing the systematics left by instabilities in the great- 
circle reduction as applied by FAST and NDAC. 
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Fig. 11. Formal errors of abscissa residual as a function of total 
intensity of the transit for orbits 95 (see also Fig. llOb and 93 in 
the NDAC reduction. The thin dots in the background are the 
equivalent values for the new reduction, for which the formal 
errors are given as a function of the total transit photon count 
or integrated intensity and the relative modulation amplitude 
(see Section lBTl . The systematic errors in orbit 95 were hidden 
behind large formal errors assigned to the abscissa residuals. 



have slipped through (orbit 59) and constitutes an example of 
how data sets could be affected (Fig. I12> . No other FAST or 
NDAC data sets appear to be affected. However, 12 th harmon- 
ics were left in the data, and an extreme example of this is also 
shown in Fig.[^] The occurrence of strong 12 th harmonics in 
the abscissa residuals is generally restricted to data sets with 
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Fig. 12. Top: The abscissa residuals for orbit 59 in the FAST 
reduction, the only orbit left with a clear 6 th harmonic mod- 
ulation of the abscissa residuals. Bottom: the same for orbit 
1506 in the NDAC reductions, an extreme example of a 12 th 
harmonic modulation. 



less than one full revolution. Most of these data sets have only 
been accepted by NDAC, but data sets with quite significant 
12 th harmonics do also occur in the FAST reductions. 



3.4. Conclusions on the great-circle reduction induced 
effects 

The coupling of the three parameter solutions in the great-circle 
reductions was necessary at the start of the processing because 
of the relatively high errors in the initial astrometric parame- 
ters for the program stars. The special conditions of the mission 
added vulnerability to instabilities to this process, but the vast 
majority of data sets are largely unaffected. Using the astromet- 
ric parameters as published in a new reduction shows that the 
solutions of the three parameter sets can now be de-coupled, 
eliminating these instabilities. 

4. The basic angle 

The stability of the basic angle, the angle between the two fields 
of view, constitutes a critical requirement of the Hipparcos mis- 
sion concept. It is one of the two fundamental conditions for 
obtaining a rigid reconstruction of the sky and determines a 
limit on the final accuracies of the astrometric parameters. One 
specific systematic modulation of the basic angle changes the 
zero point of the parallaxes and needs to be avoided above all 
others. 
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Fig. 13. A great circle (G) in the heliotropic reference frame, 
showing the relation between the angles ijj, Q„ and £h for the 
calculation of the parallax displacements along the circle for a 
star (*). The direction of the spin axis is indicated by "Sp". 

4.1. Relation with the parallax zero point 

To investigate the relation between a parallax zero-point and 
a modulation of the basic angle we first look at parallax dis- 
placements in a heliotropic reference frame: a reference frame 
in which the direction of the Sun is fixed (Fig. ll3t . We assign 
the North-pole of this reference system to the direction of the 
Sun. The displacement resulting from a parallax m is now re- 
stricted to the meridian, and a function of the co-latitude £ only: 



A£(f) = crsin^(f), 



(2) 



which reaches, as expected, a maximum for £(f) = 90°. The 
time dependence reflects the inertial rotation of the heliotropic 
reference system. Almost every great circle in the Hipparcos 
survey is tilted by 43° with respect to this system, the only ex- 
ceptions are the Sun-pointing data sets, which are tilted by 0°. 
In the coordinates of Fig.^]the local inclination of the great 
circle with respect to the local meridian is given by the angle 
if,: 



sin if/ 



sin fi» sin £h 
sin£» 



(3) 



where f, is the contemporary value of £(f) for the star observed, 
and Q.* the orientation phase or abscissa of the star. Thus, for 
Sun-pointing data sets (£h = 0°) all parallax displacements 
along the circle are zero. In all other cases, the parallax dis- 
placements along the great circle are given by: 



da = -Af sin iff, 

which, together with Eq.[2]gives: 
da - -m sin £2* sin . 



(4) 



(5) 
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Thus, the parallax displacement along the great circle only de- 
pends on the abscissa of the star and the instantaneous solar 
aspect angle of the satellite's spin axis (£ H ), but not on the or- 
dinate of the star. What is important here is the coefficient 
sin Q., in the parallax-offset relation. If a similar coefficient can 
be caused by modulation of the basic angle, then the zero-point 
of the parallax system is no longer secure. 

To understand the mechanism of the derivation below it is 
important to realise how the two processes which, through iter- 
ations, ultimately determine the Hipparcos catalogue, operate. 
The first, the along-scan attitude reconstruction, uses abscissa 
residuals as observed for stellar transits in the two fields of 
view at the same instance of time (or rotation phase Q.h of the 
satellite). The only distinction between the data from the two 
fields of view is through a fixed correction (per orbit) to the 
assumed value of the basic angle. The second process, the as- 
trometric parameter determination, uses data for the same star 
as observed in the two fields of view at different times. All ob- 
servations of a star during one orbit are associated with a nearly 
fixed value of the orientation angle Q*. Every Q* value differs 
from two associated Q# values by +y/2, and vice versa (y is 
the basic angle between the two fields of view, y/2 m 29 de- 
grees). This determination makes no distinction between data 
from the two fields of view. 

We will examine the effects of a modulation of the basic 
angle by 5ho - A ■ cos Q.n, where Iiq is defined as the correc- 
tion to half the basic angle and the subscript "H" refers to the 
position of the satellite jt-axis. This modulation reflects in the 
abscissa residuals differently for observations of the same star 
in the preceding or following field of view: 



dflp >t 
daf_„ 



A ■ cos £Ih,p 

-A ■ COS O.HJ 



A ■ cos(Q„ - y/2), 
-A ■ cos(Q« + y/2). 



(6) 



For the astrometric-parameter determination, the average com- 
bined effect from the two fields of view is: 



da* = A ■ sin Q, sin(y/2), 



(7) 



which is directly correlated with the parallax displacements as 
given by Eq. |5] Such a modulation of the basic angle will pro- 
duce a systematic offset in the measured parallaxes: on average, 
the parallax measurements for all stars will be offset by a fixed 
amount of: 



mo ~ -A 



sin(y/2) 
sin^n 



(8) 



A parallax zero-point offset will affect the along-scan atti- 
tude reconstruction, which in turn affects the measured abscissa 
residuals. In order to estimate a possible equilibrium that may 
be reached for these corrections, an additional "efficiency" fac- 
tor F is included in Eq.0 



da* = A ■ sin Q, • sin(y/2) • F, 



(9) 



The parallax zero-point offset is similarly affected by this fac- 
tor: 



sin(y/2) 
sin^H 



(10) 



The abscissa offsets as a result of the parallax zero point for a 
given value of Q.h are (Eq. |5} : 



da,,, H = -msm(Q. H + y/2) sinfo, 
da f:H = -tnr sin(Q# -y/2)sin&/. 



(11) 



The attitude model uses the average of the abscissa residuals 
for the two fields of view: 



dan - —tjq sinQ//Cos(y/2) sin^/, 
which together with Eq. 1 101 gives: 
dan — A sin Q.h sin(y/2) cos(y/2) • F, 



(12) 



(13) 



which is the attitude modulation caused by the parallax zero 
point, and relative to which the abscissa residuals are measured. 
For a given star, there will be contributions of this kind from 
observations in the preceding and following fields of view: 



da Pi » = A sin(Q» - y/2) sin(y/2) cos(y/2) • F, 
da/,* = A sin(Q» + y/2) sin(y/2) cos(y/2) • F. 

The average of these contributions equals: 

da, = A sinQ* sin(y/2)(cos(y/2)) 2 • F. 



(14) 



(15) 



Equilibrium can be reached in the iterations when the actual 
abscissa offsets caused by the basic-angle modulation as given 
by Eq.0equal the sum of the contributions from the induced at- 
titude modulation (Ea.ll5> and the measured abscissa residuals 
(Eq.0: 



1 = (1 + (cos(y/2)) ) ■ F, 



(16) 



where we divided left and right by the common factor 
A sin Q, sin(y/2). Thus, F = (1 + (cosy/2) 2 )" 1 , and the par- 
allax zero point becomes: 



vjq = -A 



sin(y/2) 



(l+(cos(y/2)) 2 )sin^ 



-0.40A. 



(17) 



Extensive tests of the zero point of the Hipparcos parallaxes 
have rev ealed no systematic offset down to an accuracy of 
0.1 mas ( Arenou et al Jl995HLindegrerJ 1995), from which we 
can infer |A| < 0.25 mas. The equivalent factor for the Gaia de- 
sign is 0.70 (assuming y = 99.4° and %h = 50°), making Gaia 
more sensitive to such disturbances than Hipparcos was. 

Any other systematic spin-synchronous modulation will be 
uncorrelated with the parallax displacements and will be ab- 
sorbed in the attitude modelling and abscissae noise. 

4.2. Basic-angle evolution, stability and drifts 

Calibration of the basic angle was performed whenever suffi- 
cient data was available. In general the basic angle shows only 
a slow evolution with time, but on a number of occasions sig- 
nificantly deviating values are observed. Both phenomena can 
be seen in Fig.^J where outlying points are observed for orbit 
1060 (day 778) and orbits 1 150 and 1 151, day 818. The first of 
these is an example of the most common reason for discrepant 
results: a restart of the on-board computer. These restarts were 
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Fig. 14. Basic-angle calibration values over a period of two 
months. For the general trend the basic-angle variations are 
well below 1 mas, but at two instances deviating values are 
observed. Both are directly related to known payload anoma- 
lies (new reduction). The vertical line at day 780 represents a 
refocusing of the instrument. 
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Fig. 15. Drifting of the basic angle as observed in orbit 852, 
probably due to a restart of the on-board computer. The mean 
residuals over intervals of about 15 minutes are shown for the 
two fields of view, but for one of the two the sign was changed. 
Thus, what is shown is twice the correction to half the basic 
angle. In this orbit the basic angle correction drifted by 8 mas 
over a period of 5 hours. 



necessitated by telemetry problems, and caused the entire pay- 
load, including heater control, to be switched off. By the time 
control was restored, the payload had changed temperature, 
which reflected in a change of the basic angle. Usually, within 
a few hours the temperature and basic angle value were back at 
their nominal values. Another example of this kind of event is 
shown in Fig.[2]for orbit 852 (day 686). A general character- 
istic of orbits thus affected is that a large fraction of the orbit, 
usually two rotations of the satellite or four hours, was spent 
on the recovery procedure, and did not produce observations. 
The second event visible in Fig.^^is due to a one-off anomaly, 
which was referred to in the operations report as an "anomalous 
under voltage". 

Drifts of the basic angle correction ho of up to 20 mas have 
been observed over the mission, and a total of 18 orbits are 
affected, 6 of these only marginally. Most of these events re- 
mained unnoticed in the production of the Hipparcos catalogue: 
the first-look processing dSchriiverll985l) focused primarily on 
well-covered orbits. 

The new reduction of the data allows further systematic 
checks to be made on the stability of the basic angle. These 
checks show generally a noise level that is below 0.2 mas. At 
that level it becomes impossible to distinguish real basic-angle 
variations from remaining systematics in the astrometric cat- 
alogue. In the new reduction, basic-angle drift corrections are 
only applied for orbits with clearly recognisable drift problems. 

4.3. Conclusions on the basic-angle stability 

The basic-angle stability for the Hipparcos mission was better 
than the requirements, except for fewer than one per cent of 
the orbits, most of which cover only half an orbit in data. The 
amount of data concerned is therefore very small, though for an 
individual star this does not need to be the case. The map of the 
great circles with basic angle drift shows some areas where up 
to 5 of these circles cross close together (Fig. [TBI. Correction 
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Fig. 16. The distribution of orbits, in equatorial coordinates, 
that are affected by basic angle drift. The small circle shows 
the position and size of the Pleiades field. 

of basic-angle drifts is often possible, though some loss of data 
quality is unavoidable for the most seriously affected orbits, as 
in these cases also the scale in the instrument parameters and 
the modulation parameters for the main grid are significantly 
affected. 

5. Connectivity 

The second requirement for the construction of absolute paral- 
laxes, good connectivity between observations in the two fields 
of view, was generally assumed to have be en taken c are off by 
the construction of the Input Catalogue JESAl[l992l) and the 
observing strategy. As was stated in the introduction, connec- 
tivity is obtained through the reconstruction of the along-scan 
attitude or scan phase. If the along-scan attitude reconstruc- 
tion is based on one field of view only, it can adapt itself to 
"faulty" astrometry, such as a local offset of the parallax zero 
point. Only by ensuring that this reconstruction is based on 
(significant) contributions from observations in both fields of 
view it becomes possible to iterate out these local adjustments 
and obtain absolute parallaxes. The global tests on the parallax 
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zero point and form al errors in the catalogue (Lindegrenl 19951 
lArenou et alJl995l) indicate that this condition was largely ful- 
filled for most of the sky in the preparation of the Hipparcos 
catalogue, but there may have been exceptions in specific re- 
gions with a h igh density of brigh t stars, such as some open 
cluster centres Jvan Leeuwenl2005l) . 



5.1. The Input Catalogue 

The distribution of stars on the sky is not ideal for a mission like 
Hipparcos, given the high range of stellar densities even for its 
limiting magnitude (Hp=12). Limitations on the telemetry and 
as imposed by the observing technique meant that no more than 
around 120 000 stars could be observed by the mission. These 
120 000 stars had to be selected from 214 000 stars requested 
in observing proposals. This task was assigned to the selection 
committee (led by Adriaan Blaauw) and the Input Cata logue 
consortium (led by Catherine Turon) JeSAII19891 Il992l) . The 
distribution of the requested stars reflects the main features of 
stellar density on the sky, such as the Milky Way and open clus- 
ters. The highest densities for the requested stars, as measured 
over 6.4 square degree fields, are about 50 times higher than 
the lowest densities. After selection the typical density range 
in the Input Catalogu e is about a factor 10. The final selection 
consists of two parts (Tu ron et all 1 992): 

- A survey of about 52 000 bright stars, which is complete 
to a limiting magnitude as a function of spectral type and 
galactic latitude; 

- About 66 000 faint stars selected from the proposed observ- 
ing programs. 

The final selections were subjected to simulations to ensure 
that the expected astrometric accuracies were possible to ob- 
tain (Creze in lESAll989h . 

The selection was optimised on stellar density but not on 
integrated light. The remaining intensity contrasts on the sky 
are generally larger, as densely populated areas are often also 
areas with bright stars. The rigidity of the Hipparcos catalogue 
depends on how the reduction software has handled those con- 
trasts, which in turn is determined by the formal errors as- 
signed to observations in the great-circle reduction process. 
The input data for this process are the reduced frame transits, 
the grid-transit data collected for a star over a fixed 2.133 s 
period (roughly one ninth of a complete field-of-view tran- 
sit). The modulation-phase estimates obtained for those tran- 
sits have formal errors that reflect the signal modulation ampli- 
tude and Poisson statist ics of the photon counts (see also Fig. 9 
in Ivan Leeuwen & Fantinol2003l) . The only exceptions are the 
very brightest stars (Hp< 2.5) where saturation disturbed the 
statistics. The relation between the formal error on the phase 
estimate and the integrated intensity for a transit is nearly con- 
stant for the mission. The main dependence is the relative am- 
plitude of the first harmonic in the grid-modulated signal. The 
formal errors on the transit positions are given by: 
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Fig. 17. Time variation of the response in the centre of the field 
for 8th mag stars of two different colour indices, showing the 
effect of aging of the detector chain through the decrease in 
response over the mission and the difference in this decrease 
for stars of different colour. 

where 7 tot is the total photon count recorded for the transit, and 
Ml the relative amplitude of the first harmonic in the signal 
modulation. The main dependences of Ml are the focal adjust- 
ment of the telescope and the colour index of the observed star. 
The value of Ml generally varied between 0.6 (red stars) and 
0.8 (blue stars). 

For single frame transits 7 tot ranges from a low of around 
40 up to 10 6 for the brightest stars. Equation^] provides the 
photon-statistics limit on the formal errors which ideally prop- 
agates all the way to the final astrometry. When also using the 
second harmonic, as was done by the FAST consortium, the 
scaling coefficient is about 5 per cent smaller: the second-order 
amplitude is approximately 0.3 times the first harmonic ampli- 
tude, adding in weight 10 per cent to the solution, and reducing 
resulting formal errors by 5 per cent. These figures have been 
confirmed through extensive tests on the real data in the new 
reduction. Thus, when using the first and second harmonic, as 
was done in the FAST reductions, the factor in Ea.ll8lbecomes 
« 242 mas. 

When the frame transits were used as input to the great- 
circle reduction, an assumed and fixed attitude noise was added 
in quadrature. The attitude noise at the frame transit level is 
generally around 3 mas. This means that above a total count 
of 10 4 the attitude noise is dominant. In comparison, the re- 
sponse of an 8 th magnitude star over the mission is shown in 
Fig. ^] Thus, from approximately magnitude 6-7 the mea- 
surement noise as implemented for the great-circle reduction 
was the fixed attitude noise rather than the photon-count statis- 
tics. This reduced the effective total intensity contrasts between 
two fields of view in some cases considerably. 

The connectivity of the data and the contribution of the at- 
titude noise show clearly from the abscissa-residual correla- 
tion statistics at orbit level. Average value s for t he wh ole mis- 
sion have been presented in V olume 3 of ESA ( 1997) and by 
Ivan Leeuwen & Evansl lll998h . However, averaged values are 
of limited use: the correlated errors originate from system- 
atic errors in the along-scan attitude fitting, and these errors 
are much more dominant for bright stars than for faint ones 
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Fig. 18. The zero- and first-order abscissa-error correlation 
peaks in the NDAC and FAST reductions for average length 
data sets and different magnitude ranges. The first-order peak 
shows the correlations introduced through the simultaneous 
measuring of stars from the two fields of view. The zero-order 
peak shows these correlations for stars at small separations. 
These correlations are the result of attitude errors, which re- 
flect most strongly for bright stars for which the photon-noise 
contribution is relatively small. 

(Fig. II 8t . Resolving the correlation statistics according to the 
magnitudes of the stars involved is not possible in detail, but 
an impression of correlation statistics when both stars fall in a 
given magnitude interval can be obtained. As one should ex- 
pect, the correlations are considerably stronger for the bright- 
star pairs than for faint-star pairs. Tests with mixed magnitude 
pairs showed that the correlation statistics for these pairs is well 
represented by the statistics for the mean magnitude. The fact 
that significant correlations can still be observed even for stars 
of magnitude 10 and above is probably a reflection of the un- 
resolved scan-phase jumps and hits in the published data, as 
it implies the presence of some systematic errors at a level of 
5 mas and more. Applying the adjusted correlation statistics to 
the Pleiades parallax solution prov ides a new cluster-p arallax 
estimate of approximately 8.0 mas ( I van Leeuwenl2005l) . about 



halfway between the earlier Hipparcos-based estimate and the 
"expected" value, and with a difference at about 1 sigma of the 
formal error on the newly derived Hipparcos-based parallax. 

5.2. The weight contrast in the Input Catalogue 

The typical weight of a given area on the sky, in comparison 
with other areas, gives a more accurate impression of the re- 
maining contrasts in the Input Catalogue than comparing num- 
ber densities of stars. These weights determine the relative in- 
fluence an area of the sky can exert on the along-scan attitude 
determination. Assuming photon noise and attitude noise as de- 
scribed above, the intensities of stars are added rather than their 
numbers. The procedure is as follows. The Hp magnitudes of 
all catalogue stars within a 1°3 radius around each catalogue 
star are collected and transformed to pseudo intensities. To rep- 
resent the modelling noise (mainly from the along-scan atti- 
tude reconstruction) all stars brighter than magnitude Hp= 7 
are treated as magnitude 7 stars. This is further referred to as 
the minimum magnitude. The intensities are added to obtain an 
integrated intensity. Thus, for each star we have available the 
number of stars within a 1°3 radius, and the integrated intensity 
for that area. While the number counts have a dynamic range 
of about 20, the intensities have a range of about 60 (Fig. I19i . 
The highest intensities are found for the cores of open clusters, 
in particular NGC 3114 in Carina and the Pleiades. Lowering 
the attitude noise, as is the case in the new reductions, lowers 
the minimum magnitude and further increases the contrast. 

Within the principles of the Hipparcos mission more weight 
is not necessarily a good thing: areas with relatively high 
weight may not conform to the requirement of connectivity. 
The result can be that in such areas the fitting of the along-scan 
attitude is based almost entirely on the data from that one field 
of view, preventing it from proper attachment to the rest of the 
catalogue. This can lead locally to astrometric data for which 
the accuracy is not fully reliable. An apparently discrepant par- 
allax determination, as has been suggested to be the case for 
the Pleiades, could be the result. The astrometry in these fields 
may be partially detached from the catalogue. As these fields 
rarely also contain stars at sufficiently large distances to be used 
as check on the parallax zero point, it is difficult to verify in- 
dependently whether this is or is not a serious (local) prob- 
lem in the Hipparcos data. There is one indication, however, 
that it possibly is not. It would be expected, given the inde- 
pendent reduction chains, for the results of such detached areas 
in the FAST and NDAC reductions to differ by more than the 
expected amount. When comparing a map of the parallax dif- 
ferences between the FAST and NDAC results with a map of 
the areas with high weight, there are at most a few marginal 
correlations. These comparisons indicate that the detachment 
due to excess weight may not play a very serious role in the re- 
liability of the Hipparcos catalogue. There is one proviso that 
needs to be made here: the tw o consortia started reductions us- 
ing the same Input Catalogue ilHS All 9921) . and used nearly the 
same data (the only differences being in stretches of data ac- 
cepted or rejected). Local systematic errors due to detachment 
may possibly, as a result, have developed in a similar way. 
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Fig. 19. Histograms of the number of stars (line) and total in- 
tensity (dots) over 5.3 square-degrees fields centred on cata- 
logue entries. The dynamic range (given by the width of the 
histogram) of the total intensity per field is significantly higher 
than for the total number of stars. 



5.3. Is re-attachment of detached areas possible? 

It is to the credit of Valeri Makarov who first identified some 
of the effects described above as a possible reason for the prob- 
lems experienced with the Pleiades parallax. Makarov also sug- 
gested and applied a method for correcting (re-connecting?) de- 
tached areas (Makarov 2002, 2003). A range of assumptions is 
made by Makarov about the way observations are distributed 
between the two fields of view. The availability of the raw data 
and a complete data analysis package allows checking those as- 
sumptions. The method of Makarov is based on the idea of in- 
corporating the abscissa residuals from the other field of view 
to correct those of a pot entially detached area . This idea had 
been first put forward bv lvan Leeuwen ( 1999b), but its imple- 
mentation was rejected on statistical grounds: for the field cov- 
ering the centre of the Pleiades cluster the unit-weight variance 
of the potentially coinciding abscissa residuals was observed to 
be smaller than that of the non-coinciding residuals. 

Makarov accumulated the data from great circles on which 
observations of a target area are contained, and selected the 
data from stars positioned on those circles at 58 ± 0.7 degrees 
from the target field, the so-called coinciding stars. By assum- 
ing that all these coinciding stars had half of their observations 
coinciding with the target field, and half not, he argued that any 
systematic residual caused by the target field will on average 
equal half of the residual of the coinciding star for that circle. 
This translates into a correction coefficient R — 2. 



Fig. 20. Distribution of the coincidence statistic p for a large se- 
lection of stars, restricted to an ordinate difference of less than 
0.75 degrees. The peak at p = represents the unsuccessful 
potentially-coinciding stars. 

To check the validity of this correction coefficient, and us- 
ing the raw data, a total of 1400 great circles were investigated, 
each containing the transits of at least 1000 different stars. For 
each star the potentially coinciding stars were selected, where 
a potentially coinciding star is situated at 58 + 0.7 degrees from 
the target star. Both the target star and the coinciding star have 
potentially observations in both fields of view, and in only one 
of those FOVs the measurements may coincide. This situation 
is represented by a statistical parameter p. If there are in total 
n, observations for the target star, and n c observations for the 
coinciding star, and there are re* coinciding observations, then: 



p = n k l V»f ' n c 



(19) 



In an ideal situation, both stars have been observed the same 
number of times, equally distributed between the two FOVs, 
and half of these observations coincided with the other star. 
In that case, p — 0.5. This is equivalent to setting R = 2 in 
iMakarovl 12002). The data for several million actual field tran- 
sits shows, however, that the real situation is far from ideal. 
To start, 35 per cent of the potentially coinciding stars never 
have any coinciding measurements and can therefore be only 
indirectly correlated. Most of these missed chances are due to 
the ordinate differences between the target and the coinciding 
star. By limiting the ordinate difference to 0.75 degrees, only 13 
per cent does not coincide. But for those that do coincide, the 
distribution over the statistic p shows an efficiency that is well 
below the ideal value of 0.5 (see Fig. 1201 . The average value 
for p in this selection is 0.32 (without the additional selection 
it is 0.26). The average value of p will decrease with increasing 
length of the time interval covered by t he great circle, as is also 
reflec ted in the correlation statistics bv lvan Leeuwen & Evansl 
( 1998). Taking therefore all potentially coinciding stars as actu- 
ally coinciding, and at the ideal distribution of observing time, 
seems highly unjustified. 

The use of the abscissa residuals from coinciding transits 
has a further risk. The noise on those residuals is composed 
of two main contributions: Poisson and attitude noise. As was 
explained above, Poisson noise dominates for stars fainter than 
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Hp= 8, while attitude noise dominates for stars brighter than 
Hp= 6. Transferring abscissa residuals from faint coinciding 
stars onto the target field will not be of any benefit for the tar- 
get field, it will only increase the overall noise levels. The fact 
that a possibly more likely answer is found by Makarov using 
this method is no proof of the validity of the method. In fact, 
his method contradicts his probably correct assumption about 
the problem with the Pleiades parallax: when assuming that the 
Pleiades region is detached from the catalogue, it is not pos- 
sible to correct it with methods that would apply only under 
condition of (nearly) ideal connectivity. On the other hand, if 
areas are ideally connected then there is no reason to apply a 
correction. 

5.4. Conclusions on connectivity 

Connectivity may have been a relatively minor issue in the con- 
struction of the Hipparcos catalogue, affecting only a few ex- 
treme areas of the sky. Unfortunately, these areas also tend to 
be some of the most interesting. However, when in a new re- 
duction the attitude noise contribution is considerably reduced, 
the weight contrasts will increase and many more areas will 
be affected. This can be prevented by artificially damping the 
weight ratio between the two fields of view to a reasonable frac- 
tion. Even so it will still be necessary to iterate the solution to 
ensure full connectivity over the whole sky. Any effects of poor 
connectivity in the published catalogue cannot be corrected af- 
terwards from the intermediate astrometric data. Connectivity 
is very releva nt for the r eduction of the astrometric data of the 
Gaia mission JPerrvmanf 2002). where contrasts are purely set 
by the actual stellar density variations on the sky, and reach 
much higher values than encountered for the Hipparcos mis- 
sion. 

6. Some statistical properties resulting from the 
merging of the data 

The great-circle reduction process and the associated potential 
for instabilities made a clean propagation of formal errors vir- 
tually impossible. In addition, the total integrated intensities of 
transits were not propagated through the reduction chain, thus 
a handle on those formal errors was effectively lost. This led 
to various "adjustments" of errors along the way: in the great- 
circle reduction results, the sphere reconstruction and the data 
merging. Some adjustments were made as a function of stellar 
magnitude, while observing-time variations implied that there 
was no clean direct relation between formal errors and those 
magnitudes. Most, but not all, features observed in the formal 
errors on the published (per-orbit) abscissae can be understood 
from the descriptions in Volume 3, Chapters 9, 11, 16 and 17 
of lESAl 1119971) . 

6.1. Propagation of errors 

As was stated before, the errors on the Hipparcos astrometry all 
originate from two sources: photon noise and modelling errors. 
The photon noise is a function of the integrated photon-count 
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Fig. 21. Abscissa residuals for the FAST and NDAC reductions 
of orbit 403. Some remaining systematics are still visible in 
both graphs. 
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Fig. 22. Formal errors as assigned to the abscissa residuals for 
orbit 403. The thin dots in the background give the formal er- 
rors for the new reduction, as based on the transit intensities 
and modulation amplitude of the first harmonic, Ml . 



and the modulation amplitude Ml, and reflects in the formal 
errors on the positional estimates as described by Eg. 1181 

The modelling noise consists of two main contributions: re- 
construction of the along-scan phase (attitude) and reconstruc- 
tion of the instrument parameters, describing the differential 
relations between positions on the sky and on the grid for the 
two fields of view and for stars of different colour indices. The 
first of these two generally dominates the modelling noise, and 
covers all the problems presented earlier in this paper: phase 
jumps, hits, eclipses and solution instabilities. 
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Fig. 23. Peculiarities in the formal errors on abscissa residuals 
for some selected orbits (see text for details). N: NDAC, F: 
FAST 



6.2. Statistical peculiarities of the merged data 

The level of the attitude noise was set empirically, based on 
the observed variance of the abscissa residuals following the 
great-circle reduction. The attitude noise thus introduced varies 
strongly from data set to data set, between lows of 1.3 mas and 
highs of 10 mas. The high noise values always hide strong sys- 
tematics in the residuals. An example of a typical good data set 
is shown in Fig. |^ and Fig.|55] with an attitude noise level for 
NDAC of 1.3 mas and for FAST 1.5 mas. The photon noise is 
observed close to the expected relation, slightly lower for FAST 
than for NDAC due to the inclusion of the second harmonic. 

Several deviations from this more or less ideal situation are 
observed. Examples of some typical situations are shown in 
Fig-HU The first example, orbit 75, top left, shows the effects 
of a single correction applied to the formal errors as part of the 
catalogue merging. As part of the merging process, the stan- 
dard errors on the FAST and NDAC great-circle results were 
"normalised". However, as at that stage information on the two 
noise components was no longer available, the "normalisation" 
was applied to all observations. As a result, it appears that noise 
levels significantly below the minimum photon noise are as- 
signed to the fainter transits, which seems unrealistic. This sit- 
uation occurs frequently for data sets from the first few months 
of the mission, as reduced by FAST. 

The second example, orbit 85, top right, shows an extreme 
case of the attitude noise contribution. In this case the attitude 
noise hides large-scale systematics in the abscissa residuals for 
a short stretch of data, caused by the instabilities in the great- 




Hp 

Fig. 24. Standard deviations (<x in mas) for the abscissa resid- 
uals as a function of the Hp magnitude. Open symbols refer 
to FAST data, filled symbols to NDAC data. The diagonal line 
represents the expected relation for Poisson noise on the pho- 
ton counts only, given identical integration times for all mag- 
nitudes. The flattening of the relation towards brighter magni- 
tudes shows the 2 mas noise contribution from the instrument 
parameters and attitude modelling. 

circle reduction described above. The attitude noise in these 
data sets is highly non-Gaussian. 

The third example, orbit 100, bottom left, shows a situa- 
tion that looks like multiple attitude noise levels having been 
applied to various short stretches of data. The cause of this be- 
haviour is still unclear. It occurs, to various degrees of severity, 
in quite a few FAST data sets. 

The final example, orbit 400, bottom right, shows a case 
where in the FAST reduction an orbit was split in two parts 
because of the presence of a large data gap (in this case the 
gap was just over one revolution of the satellite). Each part of 
the reduction was assigned an attitude noise level, and the two 
parts were later merged to one data set in the preparations for 
the merging of the FAST and NDAC data. 

How these formal errors translated into dispersions of ab- 
scissa residuals as a function of magnitude is shown in Fig. 1241 
The initial departure from the photon-noise relation is mainly 
due to amounts of observing time assigned to stars of differ- 
ent magnitudes. The flattening towards the brighter stars shows 
the average attitude noise at orbit-transit level for the published 
data. 

These statistical properties of the abscissa data imply that it 
is close to impossible to provide a reliable global abscissa-error 
correlation function for the Hipparcos data. Conditions differ 
from one orbit to the next. The same is probably also true of 
the correlation coefficients between the FAST and NDAC data. 
As a result, studies of astrometric parameters for open clusters 
are severely hampered by intrinsic uncertainties, which can no 
longer be solved a posteriori from the published data. The only 
reasonable way forward appears to be a complete re-reduction 
of the raw Hipparcos data, without the use of the great-circle 
reduction, but starting from the current published catalogue. 



Floor van Leeuwen: Rights and wrongs of the Hipparcos data 



17 



Only that way can large-scale systematics and the associated 
abscissa error correlations as well as anomalous formal errors 
on the abscissae be eliminated. 

7. Statistical verification of the astrometric data 

The verification of a data set claiming a unique level of ac- 
curacy is always very difficult. For the Hipparcos data there 
were available a very limited number of parallaxes with com- 
patible accuracies, and proper motions based on a very much 
longer base line than explored by Hipparcos. Positional refer- 
ence frames in optical wavelengths as obtained with ground- 
based instrumentation suffer from systematic errors well be- 
yond the accuracy level of the Hipparcos data. There is, how- 
ever, a small number of radio sources with astrometric param- 
eters of compatible accuracy. 

Several tests have been applied to the Hipparcos data to test 
its reliability: 

- Comparisons with any available astrometric data of com- 
patible accuracy, in optical and radio wavelengths; 

- Testing of formal errors and parallaxes for objects with neg- 
ligible parallaxes, such as stars in the SMC and LMC; 

- Comparing the distribution of negative parallaxes with the 
expected distribution for the given formal errors; 

- Comparing globally parallaxes for open clusters with pre- 
Hipparcos estimates of their distances. 

These tes ts were carried out by Lennart Lindegr en and Frederic 
Arenou (Lindegrenl l 19951 lArenou et alJll995l) . and indicated 
quite clearly that globally the parallaxes and formal errors 
formed a reliable and internally consistent data set. The inde- 
pendent tests by Arenou and Lindegren showed no systematic 
bias in the parallax zero point down to a level of 0. 1 mas, and 
confirmed the formal errors to agree with actual errors to within 
2 to 3 per cent. 

There are some aspects of these tests that would warrant 
caution on their results. The first concerns the magnitude range 
(and thus the formal error range) for the tests. The tests are 
dominated by data for faint stars, with errors set by photon 
noise only. Bright stars are generally only suitable for com- 
parisons with ground-based observations which tend to be of 
much lower accuracy than the Hipparcos data. As was shown 
above, potential connectivity problems are in particular rele- 
vant for the brighter stars. 

There is also still a small problem with the proper motions 
of cluster members. Internal proper motion dispersions in open 
clusters have been studied on the basis of differential astrome- 
try with 10 times higher precisio n than the Hipparcos data (see 
for example Ivan Leeuwenll 19941) . For the core of the Pleiades 
this dispersion is about 0.8 mas yr _1 . The intern al dispersions 
in the o pen cluster proper motions as derived bv lvan Leeuwenl 
Jl999al) and Robic hon et alJdl999l) from the Hipparcos data on 
the basis of the overall dispersion of the proper motions and 
their formal errors, are at a level of 1.5 to 2 mas yr _1 , well 
above the expected values. Detailed problems with the proper 
motions of cluster stars are also indicated when comparing the 
differential components of the Pleiades proper motions as mea- 
sured by Hipparcos with the best available differential determi- 



nation bv IVasilevskis et all lll979l) . Given the distances of the 
clusters involved, this is unlikely to be an effect of unresolved 
orbital motions. 

8. Conclusions 

Above all, it should be recognised that the two data reduction 
consortia, in close collaboration with the ESA teams at ESOC 
and ESTEC, produced a Hipparcos catalogue with astrometric 
accuracies well exceeding the original aims and expectations of 
the mission, and did so under the very difficult conditions set 
by the orbit anomaly. Criticisms that have been expressed, con- 
cern the reliability of the catalogue for one or two small areas 
of the sky, where conditions for reconstructing the best possi- 
ble astrometry may not have been sufficiently well understood 
during the data reductions. These aspects, and a range of other 
partly overlooked disturbances of the data, as well as the pos- 
sibility of now sidestepping the great-circle reduction process, 
with its potential instabilities, still create opportunities for sig- 
nificant further improvements to the catalogue, in both overall 
accuracy and statistical reliability. As the Hipparcos data is ir- 
replaceable, it is felt that this new reduction of the Hipparcos 
data needs to be done to preserve the best possible results 
from what has so far been a unique experiment. Furthermore, 
the experience obtained with the new analysis and reduction 
of the Hipparcos data is of direct benefit for the forthcoming 
Gaia mission, in particular concerning overall connectivity for 
the reconstructed astrometric catalogue and the importance of 
rigidity of the spacecraft for the along-scan attitude reconstruc- 
tion. 
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